End-to-End Localization and Ranking for Relative Attributes

We propose an end-to-end deep convolutional network to simultaneously localize and rank relative visual attributes, given only weakly-supervised pairwise image comparisons. Unlike previous methods, our network jointly learns the attribute's features, localization, and ranker. The localization module of our network discovers the most informative image region for the attribute, which is then used by the ranking module to learn a ranking model of the attribute. Our end-to-end framework also significantly speeds up processing and is much faster than previous methods. We show state-of-the-art ranking results on various relative attribute datasets, and our qualitative localization results clearly demonstrate our network's ability to learn meaningful image patches.Comment: Appears in European Conference on Computer Vision (ECCV), 201

Modeling and classification of gait patterns between anterior cruciate ligament deficient and intact knees based on phase space reconstruction, Euclidean distance and neural networks

Abstract Background The anterior cruciate ligament (ACL) plays an important role in stabilizing translation and rotation of the tibia relative to the femur. ACL injury alters knee kinematics and usually links to the alternation of gait patterns. The aim of this study is to develop a new method to distinguish between gait patterns of patients with anterior cruciate ligament deficient (ACL-D) knees and healthy controls with ACL-intact (ACL-I) knees based on nonlinear features and neural networks. Therefore ACL injury will be automatically and objectively detected. Methods First knee rotation and translation parameters are extracted and phase space reconstruction (PSR) is employed. The properties associated with the gait system dynamics are preserved in the reconstructed phase space. For the purpose of classification of ACL-D and ACL-I knee gait patterns, three-dimensional (3D) PSR together with Euclidean distance computation has been used. These measured parameters show significant difference in gait dynamics between the two groups and have been utilized to form a feature set. Neural networks are then constructed to identify gait dynamics and are utilized as the classifier to distinguish between ACL-D and ACL-I knee gait patterns based on the difference of gait dynamics between the two groups. Results Experiments are carried out on a database containing 18 patients with ACL injury and 28 healthy controls to assess the effectiveness of the proposed method. By using the twofold and leave-one-subject-out cross-validation styles, the correct classification rates for ACL-D and ACL-I knees are reported to be 91.3$$\%$$ % and 95.65$$\%$$ % , respectively. Conclusion Compared with other state-of-the-art methods, the results demonstrate that gait alterations in the presence of ACL deficiency can be detected with superior performance. The proposed method is a potential candidate for the automatic and non-invasive classification between patients with ACL deficiency and healthy subjects